Image processing method and apparatus, and electronic device

ABSTRACT

An image processing method is provided. The image processing method is applied in an electronic device. The array of photosensitive pixel units is controlled to expose with different exposure parameters and output multiple frames of color-block image. Each frame of color-block image includes image pixel units arranged in a preset array, each image pixel unit includes a plurality of original pixels, and each photosensitive pixel corresponds to one original pixel. The multiple frames of color-block image are merged to obtain a HDR color-block image. The HDR color-block image is converted to a simulation image using an interpolation algorithm. The simulation image includes simulation pixels arranged in an array, and each photosensitive pixel corresponds to one simulation pixel. An image processing apparatus and an electronic device are also provided.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of a U.S. patentapplication Ser. No. 15/805,355, filed Nov. 7, 2017, which claimspriority to Chinese Patent Application No. 201611079623.8, filed Nov.29, 2016, each of which is incorporated by reference in its entirety.

FIELD

The present disclosure relates to the imaging technology field, and moreparticularly to an image processing method, an image processingapparatus and an electronic device.

BACKGROUND

When an image is processed using a conventional image processing method,either the obtained image has a low resolution, or it takes a long timeand too much resource to obtain a HDR (high dynamic range) image, bothof which are inconvenient for users.

DISCLOSURE

The present disclosure aims to solve at least one of existing problemsin the related art to at least some extent. Accordingly, the presentdisclosure provides an image processing method, an image processingapparatus and an electronic device.

Embodiments of the present disclosure provide an image processingmethod. The image processing method is applied in an electronic device.The electronic device includes an image sensor. The image sensorincludes an array of photosensitive pixel units and an array of filterunits arranged on the array of photosensitive pixel units. Each filterunit corresponds to one photosensitive pixel unit, and eachphotosensitive pixel unit includes a plurality of photosensitive pixels.The image processing method includes: controlling the array ofphotosensitive pixel units to expose with different exposure parametersand output multiple frames of color-block image, in which, each frame ofcolor-block image includes image pixel units arranged in a preset array,each image pixel unit includes a plurality of original pixels, and eachphotosensitive pixel corresponds to one original pixel; merging themulti-frame color-block image to obtain a HDR color-block image; andconverting the HDR color-block image into a simulation image using aninterpolation algorithm, in which, the simulation image includessimulation pixels arranged in an array, and each photosensitive pixelcorresponds to one simulation pixel.

Embodiments of the present disclosure further provide an imageprocessing apparatus. The image processing apparatus is applied in anelectronic device. The electronic device includes an image sensor. Theimage sensor includes an array of photosensitive pixel units and anarray of filter units arranged on the array of photosensitive pixelunits. Each filter unit corresponds to one photosensitive pixel unit,and each photosensitive pixel unit includes a plurality ofphotosensitive pixels. The image processing apparatus includes anon-transitory computer-readable medium including computer-readableinstructions stored thereon, and an instruction execution system whichis configured by the instructions to implement at least one of a controlmodule, a merging module and a converting module. The control module isconfigured to control the array of photosensitive pixel units to exposewith different exposure parameters and output multiple frames ofcolor-block image. Each frame of color-block image includes image pixelunits arranged in a preset array. Each image pixel unit includes aplurality of original pixels, and each photosensitive pixel correspondsto one original pixel. The merging module is configured to merge themultiple frames of color-block image to obtain a HDR color-block image.The converting module is configured to convert the HDR color-block imageinto a simulation image using an interpolation algorithm. The simulationimage includes simulation pixels arranged in an array, and eachphotosensitive pixel corresponds to one simulation pixel.

Embodiments of the present disclosure provide an electronic device. Theelectronic device includes a housing, a processor, a memory, a circuitboard, a power supply circuit and an imaging apparatus. The circuitboard is enclosed by the housing. The processor and the memory arepositioned on the circuit board. The power supply circuit is configuredto provide power for respective circuits or components of the electronicdevice. The imaging apparatus includes an image sensor. The image sensorincludes an array of photosensitive pixel units and an array of filterunits arranged on the array of photosensitive pixel units. Each filterunit corresponds to one photosensitive pixel unit, and eachphotosensitive pixel unit includes a plurality of photosensitive pixels.The memory is configured to store executable program codes. Theprocessor is configured to run a program corresponding to the executableprogram codes by reading the executable program codes stored in thememory, to perform the image processing method according to embodimentsof the present disclosure.

Additional aspects and advantages of embodiments of present disclosurewill be given in part in the following descriptions, become apparent inpart from the following descriptions, or be learned from the practice ofthe embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other aspects and advantages of embodiments of the presentdisclosure will become apparent and more readily appreciated from thefollowing descriptions made with reference to the drawings.

FIG. 1 is a flow chart of an image processing method according to anembodiment of the present disclosure.

FIG. 2 is a block diagram of an image sensor according to an embodimentof the present disclosure.

FIG. 3 is a schematic diagram of an image sensor according to anembodiment of the present disclosure.

FIG. 4 is a schematic diagram illustrating a circuit of an image sensoraccording to an embodiment of the present disclosure.

FIG. 5 is a schematic diagram of an array of filter units according toan embodiment of the present disclosure.

FIG. 6 is a schematic diagram of a color-block image according to anembodiment of the present disclosure.

FIG. 7 is a flow chart of an image processing method according toanother embodiment of the present disclosure.

FIG. 8 is a schematic diagram illustrating a process of converting acolor-block image into a simulation image according to an embodiment ofthe present disclosure.

FIG. 9 is a flow chart of an image processing method according to anembodiment of the present disclosure.

FIG. 10 is a flow chart of an image processing method according to anembodiment of the present disclosure. FIG. 11 is a flow chart of animage processing method according to an embodiment of the presentdisclosure.

FIG. 12 is a schematic diagram showing an image pixel unit of acolor-block image according to an embodiment of the present disclosure.

FIG. 13 is a flow chart of an image processing method according to anembodiment of the present disclosure.

FIG. 14 is a block diagram of an image processing apparatus according toan embodiment of the present disclosure.

FIG. 15 is a block diagram of a converting module according to anembodiment of the present disclosure.

FIG. 16 is a block diagram of a third determining unit in the convertingmodule according to an embodiment of the present disclosure.

FIG. 17 is a block diagram of an image processing apparatus according toanother embodiment of the present disclosure.

FIG. 18 is a block diagram of an image processing apparatus according toanother embodiment of the present disclosure.

FIG. 19 is a block diagram of an electronic device according to anembodiment of the present disclosure.

EMBODIMENTS OF THE PRESENT DISCLOSURE

Reference will now be made in detail to exemplary embodiments, examplesof which are illustrated in the accompanying drawings, in which the sameor similar reference numbers throughout the drawings represent the sameor similar elements or elements having same or similar functions.Embodiments described below with reference to drawings are merelyexemplary and used for explaining the present disclosure, and should notbe understood as limitation to the present disclosure.

In the related art, an image sensor includes an array of photosensitivepixel units and an array of filter units arranged on the array ofphotosensitive pixel unit. Each filter unit corresponds to and coversone photosensitive pixel unit, and each photosensitive pixel unitincludes a plurality of photosensitive pixels. When working, the imagesensor is controlled to output a merged image, which can be convertedinto a merged true-color image by an image processing method and saved.The merged image includes an array of merged pixels, and thephotosensitive pixels in a same photosensitive pixel unit arecollectively outputted as one merged pixel. Thus, a signal-to-noiseratio of the merge image is increased. However, a resolution of themerged image is reduced.

Certainly, the image sensor can be controlled to output a high pixelcolor-block image, which includes an array of original pixels, and eachphotosensitive pixel corresponds to one original pixel. However, since aplurality of original pixels corresponding to a same filter unit havethe same color, the resolution of the color-block image still cannot beincreased. Thus, the high pixel color-block image needs to be convertedinto a high pixel simulation image by an interpolation algorithm, inwhich the simulation image includes a Bayer array of simulation pixels.However, when a high dynamic range (HDR for short) function is applied,a multi-frame simulation image of different brightness is needed, thatis, multiple interpolation calculations are needed, thereby consumingresource and time.

Thus, embodiments of the present disclosure provide a novel imageprocessing method.

Referring to FIG. 1, an image processing method is illustrated. Theimage processing method is applied in an electronic device. Theelectronic device includes an imaging apparatus including an imagesensor. As illustrated in FIG. 2, the image sensor 200 includes an array210 of photosensitive pixel units and an array 220 of filter unitsarranged on the array 210 of photosensitive pixel units. As illustratedin FIG. 3, each filter unit 220 a corresponds to one photosensitivepixel unit 210 a, and each photosensitive pixel unit 210 a includes aplurality of photosensitive pixels 212. In at least one embodiment,there is a one-to-one correspondence between the filter units and thephotosensitive pixel units. The image processing method includes thefollowing.

At block 10, the array of photosensitive pixel units is controlled toexpose with different exposure parameters and output multiple frames ofcolor-block image.

Each frame of color-block image includes image pixel units arranged in apreset array. Each image pixel unit includes a plurality of originalpixels, and each photosensitive pixel corresponds to one original pixel.In at least one embodiment, there is a one-to-one correspondence betweenthe photosensitive pixels and the original pixels.

At block 20, the multiple frames of color-block image are merged toobtain a HDR color-block image.

At block 30, the HDR color-block image is converted into a simulationimage using an interpolation algorithm.

The simulation image includes simulation pixels arranged in an array,and each photosensitive pixel corresponds to one simulation pixel. In atleast one embodiment, there is a one-to-one correspondence between thephotosensitive pixels and the simulation pixels.

With the image processing method according to embodiments of the presentdisclosure, in a HDR mode, the multiple frames of color-block image aremerged, and then merged HDR color-block image is converted, rather thanconverting each frame of color-block image into the simulation image andthen merging. In an embodiment of the present disclosure, only aconversion from the color-block image into the simulation image isneeded, thereby reducing computation and processing time of the imageprocessing, improving an efficiency of the HDR function, and improvingthe user experience.

FIG. 4 is a schematic diagram illustrating a circuit of an image sensoraccording to an embodiment of the present disclosure. FIG. 5 is aschematic diagram of an array of filter units according to an embodimentof the present disclosure. FIGS. 2-5 are better viewed together.

Referring to FIGS. 2-5, the image sensor 200 according to an embodimentof the present disclosure includes an array 210 of photosensitive pixelunits and an array 220 of filter units arranged on the array 210 ofphotosensitive pixel units.

Further, the array 210 of photosensitive pixel units includes aplurality of photosensitive pixel units 210 a. Each photosensitive pixelunit 210 a includes a plurality of adjacent photosensitive pixels 212.Each photosensitive pixel 212 includes a photosensitive element 2121 anda transmission tube 2122. The photosensitive element 2121 may be aphotodiode, and the transmission tube 2122 may be a MOS transistor.

The array 220 of filter units includes a plurality of filter units 220a. Each filter unit 220 a corresponding to one photosensitive pixel unit210 a.

In detail, in some examples, the filter units are arranged in a Bayerarray. In at least one embodiment, four adjacent filter units 220 ainclude one red filter unit, one blue filter unit and two green filterunits.

Each photosensitive pixel unit 210 a corresponds to a filter unit 220 awith a same color. If a photosensitive pixel unit 210 a includes nadjacent photosensitive elements 2121, one filter unit 220 a covers nphotosensitive elements 2121 in one photosensitive pixel unit 210 a. Thefilter unit 220 a may be formed integrally, or may be formed byassembling n separate sub filters.

In some implementations, each photosensitive pixel unit 210 a includesfour adjacent photosensitive pixels 212. Two adjacent photosensitivepixels 212 collectively form one photosensitive pixel subunit 2120. Thephotosensitive pixel subunit 2120 further includes a source follower2123 and an analog-to-digital converter 2124. The photosensitive pixelunit 210 a further includes an adder 213. A first electrode of eachtransmission tube 2122 in the photosensitive pixel subunit 2120 iscoupled to a cathode electrode of a corresponding photosensitive element2121. Second electrodes of all the transmission tubes 2122 arecollectively coupled to a gate electrode of the source follower 2123 andcoupled to an analog-to-digital converter 2124 via the source electrodeof the source follower 2123. The source follower 2123 may be a MOStransistor. Two photosensitive pixel subunits 2120 are coupled to theadder 213 via respective source followers 2123 and respectiveanalog-to-digital converters 2124.

In at least one embodiment, four adjacent photosensitive elements 2121in one photosensitive pixel unit 210 a of the image sensor 200 accordingto an embodiment of the present disclosure collectively use one filterunit 220 a with a same color as the photosensitive pixel unit. Eachphotosensitive element 2121 is coupled to a transmission tube 2122correspondingly. Two adjacent photosensitive elements 2121 collectivelyuse one source follower 2123 and one analog-digital converter 2124. Fouradjacent photosensitive elements 2121 collectively use one adder 213.

Further, four adjacent photosensitive elements 2121 are arranged in a2-by-2 array. Two photosensitive elements 2121 in one photosensitivepixel subunit 2120 can be in a same row.

During an imaging process, when four photosensitive elements 2121covered by a same filter unit 220 a are exposed simultaneously, thecolor-block image can be outputted by the image processing.

In detail, the photosensitive element 2121 is configured to convertlight into charges, and the amount of the charges is proportional to anillumination intensity. The transmission tube 2122 is configured tocontrol a circuit to turn on or off according to a control signal. Whenthe circuit is turned on, the source follower 2123 is configured toconvert the charge generated through light illumination into a voltagesignal. The analog-to-digital converter 2124 is configured to convertthe voltage signal into a digital signal. The adder 2122 is configuredto add and output two digital signals.

Referring to FIG. 6, take an image sensor 200 of 16M as an example. Theimage sensor according to an embodiment of the present disclosure canoutput photosensitive pixels 212 of 16M, i.e., the image sensor 200outputs the color-block image. The color-block image includes imagepixel units. The image pixel unit includes original pixels arranged in a2-by-2 array. The size of the original pixel is the same as that of thephotosensitive pixel. However, since filter unit 220 a covering fouradjacent photosensitive elements 2121 has a same color (i.e., althoughfour photosensitive elements 2121 are exposed respectively, the filterunit 220 a covers the four photosensitive elements has a same color),four adjacent original pixels in each image pixel unit of the outputimage have a same color, and thus the resolution of the image cannot beincreased.

In some embodiments, when a color-block image is output, eachphotosensitive pixel 212 is output separately. Since four adjacentphotosensitive pixels 212 have a same color, four adjacent originalpixels in an image pixel unit have a same color, which form an untypicalBayer array. However, the untypical Bayer array cannot be directlyprocessed. Therefore, it is required to convert the color-block imageinto the simulation image, and the simulation image includes simulationpixels arranged in the preset array or in the Bayer array. In this way,the image pixel unit in an untypical Bayer array can be converted intosimulation pixels arranged in the typical Bayer array.

Further, when the HDR mode is applied, the multiple frames ofcolor-block image outputted under different exposure parameters aremerged to obtain the color-block image in the HDR mode, that is, the HDRcolor-block image.

As described above, each of the image pixel units in the color-blockimage is arranged in untypical Bayer array. Therefore, it cannot bedirectly processed, and the same is true for the HDR color-block image.In at least one embodiment, if a HDR true-color image is to be output,it is required to process the HDR color-block image. For example, theHDR color-block image can be converted into the simulation image by theinterpolation algorithm.

Referring to FIG. 7, in some implementations, the act at block 30includes the following.

At block 32, it is determined whether a color of a simulation pixel isidentical to that of an original pixel at a same position as thesimulation pixel, if yes, an act at block 34 is executed, otherwise, anact at block 36 is executed.

At block 34, a pixel value of the original pixel is determined as apixel value of the simulation pixel.

At block 36, the pixel value of the simulation pixel is determinedaccording to a pixel value of an association pixel.

The association pixel is selected from an image pixel unit with a samecolor as the simulation pixel and adjacent to an image pixel unitincluding the original pixel.

Referring to FIG. 8, for the simulation pixels R3′3′ and R5′5′, thecorresponding original pixels are R33 and B55.

When the simulation pixel R3′3′ is obtained, since the simulation pixelR3′3′ has the same color as the corresponding original pixel R33, thepixel value of the original pixel R33 is directly determined as thepixel value of the simulation pixel R3′3′ during conversion.

When the simulation pixel R5′5′ is obtained, since the simulation pixelR5′5′ has a color different from that of the corresponding originalpixel B55, the pixel value of the original pixel B55 cannot be directlydetermined as the pixel value of the simulation pixel R5′5′, and it isrequired to calculate the pixel value of the simulation pixel R5′5′according to an association pixel of the simulation pixel R5′5′ by theinterpolation algorithm.

It should be noted that, a pixel value of a pixel mentioned in thecontext should be understood in a broad sense as a color attribute valueof the pixel, such as a color value.

The association pixel is selected from an association pixel unit. Theremay be more than one association pixel unit for each simulation pixel,for example, there may be four association pixel units, in which theassociation pixel units have the same color as the simulation pixel andare adjacent to the original pixel at the same position as thesimulation pixel.

It should be noted that, “adjacent” here should be understood in a broadsense. Take FIG. 8 as an example, the simulation pixel R5′5′ correspondsto the original pixel B55. The image pixel units 400, 500, 600 and 700are selected as the association pixel units, but other red image pixelunits far away from the image pixel unit where the original pixel B55 islocated are not selected as the association pixel units. In eachassociation pixel unit, the red original pixel closest to the originalpixel B55 is selected as the association pixel, which means that theassociation pixels of the simulation pixel R5′5′ include the originalpixels R44, R74, R47 and R77. The simulation pixel R5′5′ is adjacent toand has the same color as the original pixels R44, R74, R47 and R77.

In different cases, the original pixels can be converted into thesimulation pixels in different ways, thus converting the HDR color-blockimage into the simulation image. Since the image sensor 200 adopts thefilters in the Bayer array, the signal-to-noise ratio of the image isimproved. During the image processing procedure, the interpolationprocessing is performed on the HDR color-block image, such that thedistinguishability and resolution of the image can be improved.

Referring to FIG. 9, in some implementations, the act at block 36 (i.e.,determining the pixel value of the simulation pixel according to thepixel value of the association pixel) includes the following.

At block 361, a change of the color of the simulation pixel in eachdirection of at least two directions is calculated according to thepixel value of the association pixel.

At block 362, a weight in each direction of the at least two directionsis calculated according to the change.

At block 363, the pixel value of the simulation pixel is calculatedaccording to the weight and the pixel value of the association pixel.

In detail, the interpolation processing is realized as follows: withreference to energy changes of the image in different directions andaccording to weights of the association pixels in different directions,the pixel value of the simulation pixel is calculated by a linearinterpolation. From the direction having a smaller energy change, it canget a higher reference value, i.e., the weight for this direction in theinterpolation is high.

In some examples, for sake of convenience, only the horizontal directionand the vertical direction are considered.

The pixel value of the simulation pixel R5′5′ is obtained by aninterpolation based on the original pixels R44, R74, R47 and R77. Sincethere is no original pixel with a same color as the simulation pixel(i.e., R) in the horizontal direction and the vertical direction of theoriginal pixel R55 corresponding the simulation pixel R5′5′, a componentof this color (i.e., R) in each of the horizontal direction and thevertical direction is calculated according to the association pixels.The components in the horizontal direction are R45 and R75, thecomponents in the vertical direction are R54 and R57. All the componentscan be calculated according to the original pixels R44, R74, R47 andR77.

In detail, R45=R44*2/3+R47*1/3, R75=2/3*R74+1/3*R77,R54=2/3*R44+1/3*R74, R57=2/3*R47+1/3*R77.

The change of color and the weight in each of the horizontal directionand the vertical direction are calculated respectively. In at least oneembodiment, according to the change of color in each direction, thereference weight in each direction used in the interpolation isdetermined. The weight in the direction with a small change is high,while the weight in the direction with a big change is low. The changein the horizontal direction is X1=|R45-R75|. The change in the verticaldirection is X2=|R54−R57|, W1=X1/(X1+X2), W2=X2/(X1+X2).

After the above calculation, the pixel value of the simulation pixelR5′5′ can be calculated asR5′5′=(2/3*R45+1/3*R75)*W2+(2/3*R54+1/3*R57)*W1. It can be understoodthat, if X1>X2, then W1>W2. The weight in the horizontal direction isW2, and the weight in the vertical direction is W1, vice versa.

Accordingly, the pixel value of the simulation pixel can be calculatedby the interpolation algorithm. After the calculations on theassociation pixels, the original pixels can be converted into thesimulation pixels arranged in the typical Bayer array. In at least oneembodiment, four adjacent simulation pixels arranged in the 2-by-2 arrayinclude one red simulation pixel, two green simulation pixels and oneblue simulation pixel.

It should be noted that, the interpolation processing is not limited tothe above-mentioned method, in which only the pixel values of pixelswith a same color as the simulation pixel in the vertical direction andthe horizontal direction are considered during calculating the pixelvalue of the simulation pixel. In other embodiments, pixel values ofpixels with other colors can also be considered.

Referring to FIG. 10, in some embodiments, before the act at block 36,the method further includes performing a white-balance compensation onthe HDR color-block image, as illustrated at block 35 a.

Accordingly, after the act at 36, the method further includes performinga reverse white-balance compensation on the simulation image, asillustrated at block 37 a.

In detail, in some examples, when converting the HDR color-block imageinto the simulation image, during the interpolation, the red and bluesimulation pixels not only refer to the color weights of original pixelshaving the same color as the simulation pixels, but also refer to thecolor weights of original pixels with the green color. Thus, it isrequired to perform the white-balance compensation before theinterpolation to exclude an effect of the white-balance in theinterpolation calculation. In order to avoid the white-balance of thecolor-block image, it is required to perform the reverse white-balancecompensation after the interpolation according to gain values of thered, green and blue colors in the compensation.

In this way, the effect of the white-balance in the interpolationcalculation can be excluded, and the simulation image obtained after theinterpolation can keep the white-balance of the color-block image.

Referring to FIG. 10 again, in some implementations, before the act atblock 36, the method further includes performing a bad-pointcompensation on the HDR color-block image, as illustrated at block 35 b.

It can be understood that, limited by the manufacturing process, theremay be bad points in the image sensor 200. The bad point presents a samecolor all the time without varying with the photosensibility, whichaffects quality of the image. In order to ensure an accuracy of theinterpolation and prevent from the effect of the bad points, it isrequired to perform the bad-point compensation before the interpolation.

In detail, during the bad-point compensation, the original pixels aredetected. When an original pixel is detected as the bad point, thebad-point compensation is performed according to pixel values of otheroriginal pixels in the image pixel unit where the original pixel islocated.

In this way, the effect of the bad point on the interpolation can beavoided, thus improving the quality of the image.

Referring to FIG. 10 again, in some implementations, before the act atblock 36, the method includes performing a crosstalk compensation on theHDR color-block image, as illustrated at block 35 c.

In detail, four photosensitive pixels in one photosensitive pixel unitcover the filters with the same color, and the photosensitive pixels 212have differences in photosensibility, such that fixed spectrum noise mayoccur in pure-color areas in the simulation true-color image outputtedafter converting the simulation image and the quality of the image maybe affected. Therefore, it is required to perform the crosstalkcompensation.

Referring to FIG. 11, as explained above, in order to perform thecrosstalk compensation, it is required to obtain the compensationparameters during the manufacturing process of the image sensor 200, andto store the parameters related to the crosstalk compensation into thestorage of the imaging apparatus or the electronic device provided withthe imaging apparatus, such as the mobile phone or tablet computer.

In some implementations, an act of setting the compensation parametersmay include the following.

At block 351, a preset luminous environment is provided.

At block 352, imaging parameters of the imaging apparatus areconfigured.

At block 353, multi-frame images are captured.

At block 354, the multi-frame images are processed to obtain crosstalkcompensation parameters.

At block 355, the crosstalk compensation parameters are stored.

The preset luminous environment, for example, may include an LED uniformplate having a color temperature of about 5000K and a brightness ofabout 1000 lux. The imaging parameters may include a gain value, ashutter value and a location of a lens. After setting the relatedparameters, the crosstalk compensation parameters can be obtained.During the process, multiple color-block images are obtained using thepreset imaging parameters in the preset luminous environment, andcombined into one combination color-block image, such that the effect ofnoise caused by using a single color-block image as reference can bereduced.

Referring to FIG. 12, take the image pixel unit Gr as an example. Theimage pixel unit Gr includes original pixels Gr1, Gr2, Gr3 and Gr4. Thepurpose of the crosstalk compensation is to adjust the photosensitivepixels which may have different photosensibilities to have the samephotosensibility. An average pixel value of the image pixel unit isGr_avg=(Gr1+Gr2+Gr3+Gr4)/4, which represents an average level ofphotosensibilities of the four photosensitive pixels. By configuring theaverage value as a reference value, ratios of Gr1/Gr_avg, Gr2/Gr_avg,Gr3/Gr_avg and Gr4/Gr_avg are calculated. It can be understood that, bycalculating a ratio of the pixel value of each original pixel to theaverage pixel value of the image pixel unit, a deviation between eachoriginal pixel and the reference value can be reflected. Four ratios canbe recorded in a storage of a related device as the compensationparameters, and can be retrieved during the imaging process tocompensate for each original pixel, thus reducing the crosstalk andimproving the quality of the image.

Generally, after setting the crosstalk compensation parameters,verification is performed on the parameters to determine the accuracy ofthe parameters.

During the verification, a color-block image is obtained with the sameluminous environment and same imaging parameters as the preset luminousenvironment and the preset imaging parameters, and the crosstalkcompensation is performed on the color-block image according to thecalculated compensation parameters to calculate compensated Gr′_avg,Gr′1/Gr′_avg, Gr′2/Gr′_avg, Gr′3/Gr′_avg and Gr′4/Gr′_avg. The accuracyof parameters can be determined according to the calculation resultsfrom a macro perspective and a micro perspective. From the microperspective, when a certain original pixel after the compensation stillhas a big deviation which is easy to be sensed by the user after theimaging process, it means that the parameters are not accurate. From themacro perspective, when there are too many original pixels withdeviations after the compensation, the deviations as a whole can besensed by the user even if a single original pixel has a smalldeviation, and in this case, the parameters are also not accurate. Thus,a ratio threshold can be set for the micro perspective, and anotherratio threshold and a number threshold can be set for the macroperspective. In this way, the verification can be performed on thecrosstalk compensation parameters to ensure the accuracy of thecompensation parameters and to reduce the effect of the crosstalk on thequality of the image.

Referring to FIG. 13, in some implementations, after the act at block36, the method further includes performing at least one of a mirrorshape correction, a demosaicking processing, a denoising processing andan edge sharpening processing on the simulation image, as illustrated atblock 37 b.

It can be understood that, after the HDR color-block image is convertedinto the simulation image, the simulation pixels are arranged in thetypical Bayer array. The simulation image can be processed, duringwhich, the mirror shape correction, the demosaicking processing, thedenoising processing and the edge sharpening processing are included,such that the processed image can be converted into the true-colorimage.

In another aspect, the present disclosure also provides an imageprocessing apparatus.

FIG. 14 is a block diagram of an image processing apparatus according toan embodiment of the present disclosure. Referring to FIG. 14, an imageprocessing apparatus 100 is illustrated. The image processing apparatus100 is applied in an electronic device. The electronic device includesan imaging apparatus including an image sensor 200. As illustratedabove, the image sensor 200 includes an array 210 of photosensitivepixel units and an array 220 of filter units arranged on the array 210of photosensitive pixel units. Each filter unit 220 a corresponds to onephotosensitive pixel unit 210 a, and each photosensitive pixel unit 210a includes a plurality of photosensitive pixels 212. In at least oneembodiment, there is a one-to-one correspondence between thephotosensitive pixel units and the filter units. The image processingapparatus 100 includes a non-transitory computer-readable medium 160 andan instruction execution system 180. The non-transitorycomputer-readable medium 160 includes computer-executable instructionsstored thereon. The instruction execution system 180 is configured bythe instructions stored in the medium 160 to perform at least one of acontrol module 110, a merging module 120 and a converting module 130.

The control module 110 is configured to control the array ofphotosensitive pixel units to expose with different exposure parametersand output multiple frames of color-block image. Each frame ofcolor-block image includes image pixel units arranged in a preset array.Each image pixel unit includes a plurality of original pixels, and eachphotosensitive pixel 212 corresponds to one original pixel. In at leastone embodiment, there is a one-to-one correspondence between thephotosensitive pixels and the original pixels. The merging module 120 isconfigured to merge the multiple frames of color-block image to obtain aHDR color-block image. The converting module 130 is configured toconvert the HDR color-block image into a simulation image using aninterpolation algorithm. The simulation image includes simulation pixelsarranged in an array, and each photosensitive pixel 212 corresponds toone simulation pixel. In at least one embodiment, there is a one-to-onecorrespondence between the photosensitive pixels and the simulationpixels.

In at least one embodiment, the act at block 10 can be implemented bythe control module 110. The act at block 20 can be implemented by themerging module 120. The act at block 30 can be implemented by theconverting module 130.

Referring to FIG. 15, in some implementations, the converting module 130includes a first determining unit 132, a second determining unit 134,and a third determining unit 136. The first determining unit 132 isconfigured to determine whether a color of a simulation pixel isidentical to that of an original pixel at a same position as thesimulation pixel. The second determining unit 134 is configured todetermine a pixel value of the original pixel as a pixel value of thesimulation pixel when the color of the simulation pixel is identical tothat of the original pixel at the same position as the simulation pixel.The third determining unit 136 is configured to determine the pixelvalue of the simulation pixel according to pixel values of associationpixels when the color of the simulation pixel is different from that ofthe original pixel at the same position as the simulation pixel. Theassociation pixels are selected from an image pixel unit with a samecolor as the simulation pixel and adjacent to the image pixel unitincluding the original pixel.

In at least one embodiment, the act at block 32 can be implemented bythe first determining module 132. The act at block 34 can be implementedby the second determining module 134. The act at block 36 can beimplemented by the third determining module 136.

Referring to FIG. 16, in some implementations, the third determiningunit 136 includes a first calculating subunit 1361, a second calculatingsubunit 1362 and a third calculating subunit 1363. The first calculatingsubunit 1361 is configured to calculate a change of the color of thesimulation pixel in each direction of at least two directions accordingto the pixel value of the association pixel. The second calculatingsubunit 1362 is configured to calculate a weight in each direction ofthe at least two directions according to the change. The thirdcalculating subunit 1363 is configured to calculate the pixel value ofthe simulation pixel according to the weight and the pixel value of theassociation pixel.

In at least one embodiment, the act at block 361 can be implemented bythe first calculating subunit 1361. The act at block 362 can beimplemented by the second calculating subunit 1362. The act at block 363can be implemented by the third calculating subunit1363.

Referring to FIG. 17, in some implementations, the converting module 130further includes a first compensating unit 135 a and a restoring unit137 a. The first compensating unit 135 a is configured to perform awhite-balance compensation on the HDR color-block image. The restoringunit 137 a is configured to perform a reverse white-balance compensationon the simulation image.

In at least one embodiment, the act at block 35 a can be implemented bythe first compensating unit 135 a. The act at block 37 a can beimplemented by the restoring unit 137 a.

Referring to FIG. 17 again, in some implementations, the convertingmodule 130 further includes at least one of a second compensating unit135 b and a third compensating unit 135 c. The second compensating unit135 b is configured to perform a bad-point compensation on the HDRcolor-block image. The third compensating unit 135 c is configured toperform a crosstalk compensation on the HDR color-block image.

In at least one embodiment, the act at block 35 b can be implemented bythe second compensating unit 135 b. The act at block 35 c can beimplemented by the third compensating unit 135 c.

Referring to FIG. 18, in some implementations, the converting module 130includes a processing unit 137 b. The processing unit 137 b isconfigured to perform at least one of a mirror shape correction, ademosaicking processing, a denoising processing and an edge sharpeningprocessing on the simulation image. In at least one embodiment, the actat block 37 b can be implemented by the processing unit 137 b.

The present disclosure also provides an electronic device.

FIG. 19 is a block diagram of an electronic device according to anembodiment of the present disclosure. Referring to FIG. 19, theelectronic device 10000 of the present disclosure includes a housing10001, a processor 10002, a memory 10003, a circuit board 10006, a powersupply circuit 10007 and an imaging apparatus 2000. The circuit board10006 is enclosed by the housing 10001. The processor 10002 and thememory 10003 are positioned on the circuit board 10006. The power supplycircuit 10007 is configured to provide power for respective circuits orcomponents of the electronic device 10000. The memory 10003 isconfigured to store executable program codes.

The imaging apparatus 2000 includes an image sensor 200. As illustratedabove, the image sensor 200 includes an array 210 of photosensitivepixel units and an array 220 of filter units arranged on the array 210of photosensitive pixel units. Each filter unit 220 a corresponds to onephotosensitive pixel unit 210 a, and each photosensitive pixel unit 210a includes a plurality of photosensitive pixels 212. In at least oneembodiment, there is a one-to-one correspondence between thephotosensitive pixel units and the filter units.

The processor 10002 is configured to run a program corresponding to theexecutable program codes by reading the executable program codes storedin the memory, to perform the following operations: controlling thearray of photosensitive pixel units to expose with different exposureparameters and output multiple frames of color-block image, in which,each frame of color-block image includes image pixel units arranged in apreset array, each image pixel unit includes a plurality of originalpixels, and each photosensitive pixel corresponds to one original pixel;merging the multiple frames of color-block image to obtain a HDRcolor-block image; and converting the HDR color-block image into asimulation image using an interpolation algorithm, in which, thesimulation image includes simulation pixels arranged in an array, andeach photosensitive pixel corresponds to one simulation pixel.

In some implementations, the imaging apparatus includes a front cameraor a real camera (not illustrated in FIG. 19).

In some implementations, the processor 10002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory, to perform converting theHDR color-block image into a simulation image using an interpolationalgorithm by acts of: determining whether a color of a simulation pixelis identical to that of an original pixel at a same position as thesimulation pixel; when the color of the simulation pixel is identical tothat of the original pixel at the same position as the simulation pixel,determining a pixel value of the original pixel as a pixel value of thesimulation pixel; and when the color of the simulation pixel isdifferent from that of the original pixel at the same position as thesimulation pixel, determining the pixel value of the simulation pixelaccording to a pixel value of an association pixel, in which theassociation pixel is selected from an image pixel unit with a same coloras the simulation pixel and adjacent to an image pixel unit includingthe original pixel.

In some implementations, the processor 1002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory, to perform determiningthe pixel value of the simulation pixel according to a pixel value of anassociation pixel by acts of: calculating a change of the color of thesimulation pixel in each direction of at least two directions accordingto the pixel value of the association pixel; calculating a weight ineach direction of the at least two directions according to the change;and calculating the pixel value of the simulation pixel according to theweight and the pixel value of the association pixel.

In some implementations, the processor 10002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory, to perform the followingoperations: performing a white-balance compensation on the HDRcolor-block image; and performing a reverse white-balance compensationon the simulation image.

In some implementations, the processor 10002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory, to perform the followingoperation: performing at least one of a bad-point compensation and acrosstalk compensation on the HDR color-block image.

In some implementations, the processor 10002 is configured to run aprogram corresponding to the executable program codes by reading theexecutable program codes stored in the memory, to perform the followingoperations: performing at least one of a mirror shape correction, ademosaicking processing, a denoising processing and an edge sharpeningprocessing on the simulation image.

In some implementations, the electronic device may be a mobile phone ora tablet computer, which is not limited herein.

The electronic device 10000 may further include an inputting component(not illustrated in FIG. 19). It should be understood that, theinputting component may further include one or more of the following: aninputting interface, a physical button of the electronic device 10000, amicrophone, etc.

It should be understood that, the electronic device 10000 may furtherinclude one or more of the following components (not illustrated in FIG.19): an audio component, an input/output (I/O) interface, a sensorcomponent and a communication component. The audio component isconfigured to output and/or input audio signals, for example, the audiocomponent includes a microphone. The I/O interface is configured toprovide an interface between the processor 10002 and peripheralinterface modules. The sensor component includes one or more sensors toprovide status assessments of various aspects of the electronic device10000. The communication component is configured to facilitatecommunication, wired or wirelessly, between the electronic device 10000and other devices.

It is to be understood that phraseology and terminology used herein withreference to device or element orientation (such as, terms like“center”, “longitudinal”, “lateral”, “length”, “width”, “height”, “up”,“down”, “front”, “rear”, “left”, “right”, “vertical”, “horizontal”,“top”, “bottom”, “inside”, “outside”, “clockwise”, “anticlockwise”,“axial”, “radial”, “circumferential”) are only used to simplifydescription of the present invention, and do not indicate or imply thatthe device or element referred to must have or operated in a particularorientation. They cannot be seen as limits to the present disclosure.

Moreover, terms of “first” and “second” are only used for descriptionand cannot be seen as indicating or implying relative importance orindicating or implying the number of the indicated technical features.Thus, the features defined with “first” and “second” may comprise orimply at least one of these features. In the description of the presentdisclosure, “a plurality of” means two or more than two, unlessspecified otherwise.

In the present disclosure, unless specified or limited otherwise, theterms “mounted,” “connected,” “coupled,” “fixed” and the like are usedbroadly, and may be, for example, fixed connections, detachableconnections, or integral connections; may also be mechanical orelectrical connections; may also be direct connections or indirectconnections via intervening structures; may also be inner communicationsof two elements or interactions of two elements, which can be understoodby those skilled in the art according to specific situations.

In the present disclosure, unless specified or limited otherwise, astructure in which a first feature is “on” a second feature may includean embodiment in which the first feature directly contacts the secondfeature, and may also include an embodiment in which the first featureindirectly contacts the second feature via an intermediate medium.Moreover, a structure in which a first feature is “on”, “over” or“above” a second feature may indicate that the first feature is rightabove the second feature or obliquely above the second feature, or justindicate that a horizontal level of the first feature is higher than thesecond feature. A structure in which a first feature is “below”, or“under” a second feature may indicate that the first feature is rightunder the second feature or obliquely under the second feature, or justindicate that a horizontal level of the first feature is lower than thesecond feature.

Various embodiments and examples are provided in the followingdescription to implement different structures of the present disclosure.In order to simplify the present disclosure, certain elements andsettings will be described. However, these elements and settings areonly examples and are not intended to limit the present disclosure. Inaddition, reference numerals may be repeated in different examples inthe disclosure. This repeating is for the purpose of simplification andclarity and does not refer to relations between different embodimentsand/or settings. Furthermore, examples of different processes andmaterials are provided in the present disclosure. However, it would beappreciated by those skilled in the art that other processes and/ormaterials may be also applied.

Reference throughout this specification to “an embodiment,” “someembodiments,” “an example,” “a specific example,” or “some examples,”means that a particular feature, structure, material, or characteristicdescribed in connection with the embodiment or example is included in atleast one embodiment or example of the present disclosure. In thisspecification, exemplary descriptions of aforesaid terms are notnecessarily referring to the same embodiment or example. Furthermore,the particular features, structures, materials, or characteristics maybe combined in any suitable manner in one or more embodiments orexamples. Moreover, those skilled in the art could combine differentembodiments or different characteristics in embodiments or examplesdescribed in the present disclosure.

Any process or method described in a flow chart or described herein inother ways may be understood to include one or more modules, segments orportions of codes of executable instructions for achieving specificlogical functions or steps in the process, and the scope of a preferredembodiment of the present disclosure includes other implementations,wherein the order of execution may differ from that which is depicted ordiscussed, including according to involved function, executingconcurrently or with partial concurrence or in the contrary order toperform the function, which should be understood by those skilled in theart.

The logic and/or step described in other manners herein or shown in theflow chart, for example, a particular sequence table of executableinstructions for realizing the logical function, may be specificallyachieved in any computer readable medium to be used by the instructionexecution system, device or equipment (such as the system based oncomputers, the system comprising processors or other systems capable ofacquiring the instruction from the instruction execution system, deviceand equipment and executing the instruction), or to be used incombination with the instruction execution system, device and equipment.As to the specification, “the computer readable medium” may be anydevice adaptive for including, storing, communicating, propagating ortransferring programs to be used by or in combination with theinstruction execution system, device or equipment. More specificexamples of the computer-readable medium comprise but are not limitedto: an electronic connection (an electronic device) with one or morewires, a portable computer enclosure (a magnetic device), a randomaccess memory (RAM), a read-only memory (ROM), an erasable programmableread-only memory (EPROM or a flash memory), an optical fiber device anda portable compact disk read-only memory (CDROM). In addition, thecomputer-readable medium may even be a paper or other appropriate mediumcapable of printing programs thereon, this is because, for example, thepaper or other appropriate medium may be optically scanned and thenedited, decrypted or processed with other appropriate methods whennecessary to obtain the programs in an electric manner, and then theprograms may be stored in the computer memories.

It should be understood that each part of the present disclosure may berealized by hardware, software, firmware or their combination. In theabove embodiments, a plurality of steps or methods may be realized bythe software or firmware stored in the memory and executed by theappropriate instruction execution system. For example, if it is realizedby the hardware, likewise in another embodiment, the steps or methodsmay be realized by one or a combination of the following techniquesknown in the art: a discrete logic circuit having a logic gate circuitfor realizing a logic function of a data signal, an application-specificintegrated circuit having an appropriate combination logic gate circuit,a programmable gate array (PGA), a field programmable gate array (FPGA),etc.

Those skilled in the art shall understand that all or parts of the stepsin the above exemplifying method for the present disclosure may beachieved by commanding the related hardware with programs , the programsmay be stored in a computer-readable storage medium, and the programscomprise one or a combination of the steps in the method embodiments ofthe present disclosure when running on a computer.

In addition, each function cell of the embodiments of the presentdisclosure may be integrated in a processing module, or these cells maybe separate physical existence, or two or more cells are integrated in aprocessing module. The integrated module may be realized in a form ofhardware or in a form of software function modules. When the integratedmodule is realized in a form of software function module and is sold orused as a standalone product, the integrated module may be stored in acomputer-readable storage medium.

The storage medium mentioned above may be read-only memories, magneticdisks, CD, etc.

Although embodiments of present disclosure have been shown and describedabove, it should be understood that above embodiments are justexplanatory, and cannot be construed to limit the present disclosure,for those skilled in the art, changes, alternatives, and modificationscan be made to the embodiments without departing from spirit, principlesand scope of the present disclosure.

What is claimed is:
 1. A controlling method, configured to control anelectronic device, wherein the electronic device comprises an imagingapparatus and a display, the imaging apparatus comprises an imagesensor, the image sensor comprises an array of photosensitive pixelunits and an array of filter units arranged on the array ofphotosensitive pixel units, each filter unit covers one correspondingphotosensitive pixel unit, and each photosensitive pixel unit comprisesa plurality of photosensitive pixels, the controlling method comprises:controlling the array of photosensitive pixel units to expose withdifferent exposure parameters and output a plurality of color-blockimages, wherein, each color-block image comprises original pixelsarranged in a preset array, and each photosensitive pixel corresponds toone original pixel; merging the plurality of color-block images toobtain a HDR (high dynamic range) color-block image; and converting theHDR color-block image into a simulation image using an interpolationalgorithm, wherein, the simulation image comprises simulation pixelsarranged in the preset array.
 2. The controlling method according toclaim 1, wherein the color-block image comprises image pixel unitsarranged in the preset array, each image pixel unit comprises aplurality of original pixels having a same color, the simulation imagecomprises a plurality of simulation pixels arranged in the preset array,the simulation pixel comprises a current pixel, and the original pixelcomprises an association pixel corresponding to the current pixel, aposition of the association pixel in the color-block image correspondsto a position of the current pixel in the simulation image, andconverting the HDR color-block image into the simulation image using theinterpolation algorithm comprises: determining whether a color of thecurrent pixel is identical to that of the association pixel; when thecolor of the current pixel is identical to that of the associationpixel, determining a pixel value of the association pixel as a pixelvalue of the current pixel; and when the color of the current pixel isdifferent from that of the association pixel, determining the pixelvalue of the current pixel according to pixel values corresponding to anassociation pixel unit through the interpolation algorithm, wherein thearray of the image pixel units comprises the association pixel unit, anda color of the association pixel unit is identical to that of thecurrent pixel and the association pixel unit is adjacent to theassociation pixel.
 3. The controlling method according to claim 1,wherein the preset array comprises a Bayer array.
 4. The controllingmethod according to claim 2, wherein the image pixel unit comprisesoriginal pixels arranged in a 2*2 array.
 5. The controlling methodaccording to claim 2, wherein, determining the pixel value of thecurrent pixel according to the pixel values corresponding to theassociation pixel unit through the interpolation algorithm comprises:calculating a change in each direction of the association pixel;calculating a weight in each direction of the association pixel; andcalculating the pixel value of the current pixel according to the changeand the weight.
 6. The controlling method according to claim 2, beforedetermining the pixel value of the current pixel according to the pixelvalues corresponding to the association pixel unit through theinterpolation algorithm, further comprising: performing a white-balancecompensation on the HDR color-block image; and after determining thepixel value of the current pixel according to the pixel valuescorresponding to the association pixel unit through the interpolationalgorithm, further comprising: performing a reverse white-balancecompensation on the simulation image.
 7. The controlling methodaccording to claim 2, before determining the pixel value of the currentpixel according to the pixel values corresponding to the associationpixel unit through the interpolation algorithm, further comprising:performing a bad-point compensation on the HDR color-block image.
 8. Thecontrolling method according to claim 2, before determining the pixelvalue of the current pixel according to the pixel values correspondingto the association pixel unit through the interpolation algorithm,further comprising: performing a crosstalk compensation on the HDRcolor-block image.
 9. The controlling method according to claim 2, afterdetermining the pixel value of the current pixel according to the pixelvalues corresponding to the association pixel unit through theinterpolation algorithm, further comprising: performing a lens shadingcorrection, a demosaicing processing, a denoising processing and an edgesharpening processing on the simulation image.
 10. A controllingapparatus, configured to control an electronic device, wherein theelectronic device comprises an imaging apparatus and a displayer, theimaging apparatus comprises an image sensor, the image sensor comprisesan array of photosensitive pixel units and an array of filter unitsarranged on the array of photosensitive pixel units, each filter unitcovers one corresponding photosensitive pixel unit, and eachphotosensitive pixel unit comprises a plurality of photosensitivepixels; the controlling apparatus comprises a non-transitorycomputer-readable medium comprising computer-executable instructionsstored thereon, and an instruction execution system which is configuredby the instructions to implement: a control module, configured tocontrol the array of photosensitive pixel units to expose with differentexposure parameters and output a plurality of color-block images,wherein, each color-block image comprises a plurality of original pixelsarranged in a preset array, and each photosensitive pixel corresponds toone original pixel; a merging module, configured to merge the pluralityof color-block images to obtain a HDR (high dynamic range) color-blockimage; and an image processing module, configured to convert the HDRcolor-block image into a simulation image using an interpolationalgorithm, wherein, the simulation image comprises simulation pixelsarranged in a preset array.
 11. The controlling apparatus according toclaim 10, wherein the color-block image comprises image pixel unitsarranged in the preset array, each image pixel unit comprises aplurality of original pixels having a same color, the simulation imagecomprises a plurality of simulation pixels arranged in the preset array,the plurality of simulation pixels comprise a current pixel, and theplurality of original pixels comprises an association pixelcorresponding to the current pixel, a position of the association pixelin the color-block image corresponds to a position of the current pixelin the simulation image, the image processing module comprises: adetermining unit, configured to determine whether a color of the currentpixel is identical to that of the association pixel; a first calculationunit, configured to determine a pixel value of the association pixel asa pixel value of the current pixel, when the color of the current pixelis identical to that of the association pixel; and a second calculationunit, configured to determine the pixel value of the current pixelaccording to pixel values corresponding to an association pixel unitthrough the interpolation algorithm, when the color of the current pixelis different from that of the association pixel, wherein pixel unitscomprise the association pixel unit, and a color of the associationpixel unit is identical to that of the current pixel and the associationpixel unit is adjacent to the association pixel.
 12. The controllingapparatus according to claim 10, wherein the preset array comprises aBayer array.
 13. The controlling apparatus according to claim 11,wherein the image pixel unit comprises original pixels arranged in a 2*2array.
 14. The controlling apparatus according to claim 11, wherein thesecond calculating unit comprises: a first calculating subunit,configured to calculate a change in each direction of the associationpixel; a second calculating subunit, configured to calculate a weight ineach direction of the association pixel; and a third calculatingsubunit, configured to calculate the pixel value of the current pixelaccording to the change and the weight.
 15. The controlling apparatusaccording to claim 11, wherein the image processing module comprises: awhite-balance compensating unit, configured to perform a white-balancecompensation on the HDR color-block image; and a white-balance restoringunit, configured to perform a reverse white-balance compensation on thesimulation image.
 16. The controlling apparatus according to claim 11,wherein the image processing module comprises: a bad-point compensatingunit, configured to perform a bad-point compensation on the HDRcolor-block image.
 17. The controlling apparatus according to claim 11,wherein the image processing module comprises: a crosstalk compensatingunit, configured to perform a crosstalk compensation on the HDRcolor-block image.
 18. The controlling apparatus according to claim 11,wherein the image processing module comprises: a processing unit,configured to perform a lens shading correction, a demosaicingprocessing, a denoising processing and an edge sharpening processing onthe simulation image.
 19. An electronic device, comprising: an imagingapparatus; a display; and a controlling apparatus wherein the imagingapparatus comprises an image sensor, the image sensor comprises an arrayof photosensitive pixel units and an array of filter units arranged onthe array of photosensitive pixel units, each filter unit covers onecorresponding photosensitive pixel unit, and each photosensitive pixelunit comprises a plurality of photosensitive pixels; the controllingapparatus is configured to: control the array of photosensitive pixelunits to expose with different exposure parameters and output aplurality of color-block images, wherein, each color-block imagecomprises a plurality of original pixels arranged in a preset array, andeach photosensitive pixel corresponds to one original pixel; merge theplurality of color-block images to obtain a HDR (high dynamic range)color-block image; and convert the HDR color-block image into asimulation image using an interpolation algorithm, wherein, thesimulation image comprises simulation pixels arranged in a preset array.20. The electronic device according to claim 19, wherein the color-blockimage comprises image pixel units arranged in the preset array, eachimage pixel unit comprises a plurality of original pixels having a samecolor, the simulation image comprises a plurality of simulation pixelsarranged in the preset array, the plurality of simulation pixelscomprise a current pixel, and the plurality of original pixels comprisesan association pixel corresponding to the current pixel, a position ofthe association pixel in the color-block image corresponds to a positionof the current pixel in the simulation image, and the controllingapparatus is further configured to: determine whether a color of thecurrent pixel is identical to that of the association pixel; determine apixel value of the association pixel as a pixel value of the currentpixel, when the color of the current pixel is identical to that of theassociation pixel; and determine the pixel value of the current pixelaccording to pixel values corresponding to an association pixel unitthrough the interpolation algorithm, when the color of the current pixelis different from that of the association pixel, wherein pixel unitscomprise the association pixel unit, and a color of the associationpixel unit is identical to that of the current pixel and the associationpixel unit is adjacent to the association pixel.